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Abstract 

We discuss the metastate, a probability measure on thermodynamic states, and 
its usefulness in addressing difficult questions pertaining to the statistical mechanics 
of systems with quenched disorder, in particular short-range spin glasses. The 
possible low-temperature structures of realistic (i.e., short-range) spin glass models 
are described, and a number of fundamental open questions are presented. 

1 Introduction 

The nature of the low-temperature spin glass phase in short-range models remains one of 
the central problems in the statistical mechanics of disordered systems [1, 2, 3, 4, 5, 6, 7]. 
While many of the basic questions remain unanswered, analytical and rigorous work over 
the past decade have greatly streamlined the number of possible scenarios for pure state 
structure and organization at low temperature, and have clarified the thermodynamic 
behavior of these systems. 

The unifying concept behind this work is that of the metastate. It arose independently 
in two different constructions [8, 9], which were later shown to be equivalent [10]. The 
metastate is a probability measure on the space of all thermodynamic states. Its useful- 
ness arises in situations where multiple "competing" pure states may be present. In such 
situations it may be difficult to construct individual states in a measurable and canonical 
way; the metastate avoids this difficulty by focusing instead on statistical properties of 
the states. 

An important aspect of the metastate approach is that it relates, by its very con- 
struction [9], the observed behavior of a system in large but finite volumes with its 
thermodynamic properties. It therefore serves as a (possibly indispensable) tool for an- 
alyzing and understanding both the infinite-volume and finite-volume properties of a 
system, particularly in cases where a straightforward interpolation between the two may 
be incorrect, or their relation otherwise difficult to analyze. 
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We will focus on the Edwards- Anderson (EA) Ising spin glass model [11], although 
most of our discussion is relevant to a much larger class of realistic models. The EA 
model is described by the Hamiltonian 

Hj = - JxyVxVy , (1) 

(*>y) 

where J denotes a particular realization of all of the couplings J xy and the brackets 
indicate that the sum is over nearest-neighbor pairs only, with x, y e Z d . We will 
take Ising spins, o x = ±1; although this will affect the details of our discussion, it 
is unimportant for our main conclusions. The couplings J xy are quenched, independent, 
identically distributed random variables whose common distribution p is symmetric about 
zero. 

2 States and Metastates 

We are interested in both finite-volume and infinite-volume Gibbs states. For the cube 
of length scale L, Al = {—L, —L + 1, • • • , L} d , we define H.j,l to be the restriction of the 
EA Hamiltonian to Al with a specified boundary condition (b.c.) such as free or fixed 
or periodic. Then the finite- volume Gibbs distribution pjf 1 = pj^^ on A L (at inverse 
temperature f3 — 1/T) is: 

p%{o) = z- I }^ v {-mjA°)} , (2) 

where the partition function Zl{{3) is such that the sum of pj^ over all a yields one. 
(In this and all succeeding definitions, the dependence on spatial dimension d will be 
suppressed.) 

Thermodynamic states are described by infinite-volume Gibbs measures. At fixed 
inverse temperature (5 and coupling realization J, a thermodynamic state pj$ is the 
limit, as L — > oo, of some sequence of such finite- volume measures (each with a speci- 
fied b.c, which may remain the same or may change with L). A thermodynamic state 
p can also be characterized intrinsically through the Dobrushin-Lanford-Ruelle (DLR) 
equations [12]: for any A^, the conditional distribution of pj$ (conditioned on the sigma- 
field generated by {<j x : x G Z^A^} is Pj]p , where a is given by the conditioned values 
of a x for a; on the boundary of A^. 

Consider now the set Q = Q{J, (3) of all thermodynamic states at a fixed {J, f3). The 
set of extremal, or pure, Gibbs states is defined by 

ex g = g \ {api + (1 - a)p 2 : a E (0, 1); pi, p 2 G Q\ pi ^ p 2 } , (3) 

and the number of pure states N{3^,f3) at {J,f3) is the cardinality |ex Q\ of ex Q. It is 
not hard to show that, in any d and for a.e. J7", the following two statements are true: 1) 
Af = 1 at sufficiently low (3 > ; 2) at any fixed f3, Af is constant a.s. with respect to 
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the J7"'s. (The last follows from the measurability and translation-invariance of Af, and 
the translation-ergodicity of the disorder distribution of J .) 

A pure state p a (where a is a pure state index) can also be intrinsically characterized 
by a clustering property; for two-point correlation functions this reads 

(<rx<r y ) Pa - {Px)p a {°y) Pa ~* ( 4 ) 

as \x — y\ — > oo. A simple observation [13] with important consequences for spin glasses, 
is that if many pure states exist, a sequence of p^jj's, with b.c.'s and L's chosen inde- 
pendently of J , will generally not have a (single) limit. We call this phenomenon chaotic 
size dependence (CSD). 

We will be interested in the properties of ex Q at low temperature. If the spin-flip 
symmetry present in the EA Hamiltonian Eq. (1) is spontaneously broken above some 
dimension d and below some temperature T c (d), there will be at least a pair of pure 
states, such that their even-spin correlations are identical, and their odd-spin correlations 
have the opposite sign. Assuming that such broken spin-flip symmetry indeed exists for 
d > do and T < T c (d), the question of whether there exists more than one such pair 
(of spin-flip related extremal infinite-volume Gibbs distributions) is a central unresolved 
issue for the EA and related models. If many such pairs should exist, we can ask about 
the structure of their relations to one another, and how this structure would manifest 
itself in large but finite volumes. 

To do this we use an approach, introduced in Ref . [9] , to studying inhomogeneous and 
other systems with many competing pure states. This approach, based on an analogy to 
chaotic dynamical systems, requires the construction of a new thermodynamic quantity 
which we call the metastate, which is a probability measure Kj on the thermodynamic 
states. The metastate allows an understanding of CSD by analyzing the way in which 
Pj\ "samples" from its various possible limits as L — > oo. 

The analogy with chaotic dynamical systems can be understood as follows. In dy- 
namical systems, the chaotic motion along a deterministic orbit is analyzed in terms of 
some appropriately selected probability measure, invariant under the dynamics. Time 
along the orbit is replaced, in our context, by L and the phase space of the dynamical 
system is replaced by the space of Gibbs states. 

In [9], we considered (as always, at fixed f3, which will hereafter be suppressed for 
ease of notation) a 'microcanonical ensemble' in which each of the finite- volume Gibbs 
states pj' 1 \pj' 2 \ . . . ,p^j N ^ has weight A -1 . The ensemble k n converges to a metastate 
Kj as N — > oo, in the following sense: for every (nice) function g on states (e.g., a 
function of finitely many correlations), 



N 

lim N- 1 52g(pM)= g(T)dKj(T) . (5) 



The information contained in kj effectively specifies the fraction of cube sizes which 
the system spends in different (possibly mixed) thermodynamic states r as £ — > oo. 
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A different, but in the end equivalent approach, based on jT-randomness, is due to 
Aizenman and Wehr [8]. Here one considers the random pair (J~,p^), defined on the 
underlying probability space of J7", and takes the limit (with conditional distribution 
k'j, given J), via finite dimensional distributions along some subsequence. We omit 
details here, and refer the reader to [8, 10]. We note, though, the important result that 
a deterministic subsequence of volumes can be found on which both (5) is valid and 
{JiP^) converges, with Kj = kj [10]. 

In what follows we use the term "metastate" as shorthand for the Kj constructed 
using periodic b.c.'s on a sequence of volumes chosen independently of the couplings, 
and along which kj = Kj. We choose periodic b.c.'s for specificity; the results and 
claims discussed are expected to be independent of the boundary conditions used, as 
long as they are chosen independently of the couplings. 

3 Low Temperature Structure of the EA Model 

There have been several scenarios proposed for the spin glass phase of the Edwards- 
Anderson model at sufficiently low temperature and high dimension. These remain 
speculative, because it has not even been proved that a phase transition from the high- 
temperature phase exists at positive temperature in any finite dimension. 

We noted earlier that, at sufficiently high temperature in any dimension (and at all 
nonzero temperatures in one and presumably two dimensions, though the latter assertion 
has not been proved), there is a unique Gibbs state. It is conceivable that this remains 
the case in all dimensions and at all nonzero temperatures, in which case the metastate 
kj is, for a.e. J , supported on a single, pure Gibbs state pj. (It is important to note, 
however, that in principle such a trivial metastate could occur even if Af > 1; indeed, just 
such a situation of "weak uniqueness" [14, 15] happens in very long range spin glasses at 
high temperature [16, 17].) 

A phase transition has been proved to exist [18] in the Sherrington-Kirkpatrick (SK) 
model [19], which is the infinite-range version of the EA model. Numerical [1, 20, 21, 
22] and some analytical [23, 24] work has led to a general consensus that above some 
dimension (typically around three or four) there does exist a positive temperature phase 
transition below which spin-flip symmetry is broken, i.e., in which pure states come in 
pairs, as discussed below Eq. (4). Because much of the literature has focused on this 
possibility, we assume it in what follows, and will see that the metastate approach is 
highly useful in restricting the scenarios that can occur. 

The simplest such scenario is a two-state picture in which, below the transition tem- 
perature T c , there exists a single pair of global flip-related pure states pj and pj a . In 
this case there is no CSD for periodic b.c.'s and the metastate can be written 

That is, the metastate is supported on a single (mixed) thermodynamic state. 
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The two-state scenario that has received the most attention in the literature is the 
droplet/scaling picture [25, 26, 27]. In this picture a low-energy excitation above the 
ground state in A L is a droplet whose surface area scales as l ds , with I ~ O(L) and d s < d, 
and whose surface energy scales as I , with 9 > (in dimensions where T c > 0). More 
recently, an alternative picture has arisen [28, 29] in which the low-energy excitations 
differ from those of droplet /scaling in that their energies scale as I 6 ' , with 9' = 0. 

The low-temperature picture that has perhaps generated the most attention in the 
literature is the replica symmetry breaking (RSB) scenario [1, 6, 30, 31, 32, 33, 34, 35], 
which assumes a rather complicated pure state structure, inspired by Parisi's solution 
of the SK model [3, 36, 37, 38]. This is a many-state picture (M = oo for a.e. J) in 
which the ordering is described in terms of the overlaps between states. There has been 
some ambiguity in how to describe such a picture for short-range models; we start with 
the prevailing, or standard, view. Consider any reasonably constructed thermodynamic 
state pj (see [10] for more details) — e.g, the average over the metastate kj 

pj = J TdKj(T) . (7) 

Now choose a and a 1 from the product distribution pj(o~)pj(a'). The overlap Q is 
defined as 

Q= lim \Al\~ 1 (8) 

L ^°° xeA L 

and Pj(q) is defined to be its probability distribution. 

In the standard RSB picture pj is a mixture of infinitely many pure states, each with 
a specific j7-dependent weight W: 

pA°) = Y. w jPj(°) ■ (9) 

a 

If a is drawn from pj and a' from pj, then the expression in Eq. (8) equals its thermal 
mean, 

qf = lim (AlT 1 Yl ( a x)a(o- x )p , (10) 
xeA L 

and hence Pj is given by 

Pj(q) = T,WjWfrb-<&) ■ (n) 

The self-overlap, or EA order parameter, is given by qEA = q'j 1 and (at fixed T) is 
thought to be independent of both a and J (with probability one). 

According to the standard RSB scenario, the WjS and q'j s are non-self-averaging 
(i.e., j7-dependent) quantities, except for a = (3 or its global flip, where q°j = ±qEA- The 
average P s (q) of Pj(q) over the disorder distribution of J is predicted to be a mixture 
of two delta-function components at ±qEA and a continuous part between them. 
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However, it was proved in [39] that this scenario cannot occur, because of the translation- 
invariance of Pj{q) and the translation-ergodicity of the disorder distribution. Neverthe- 
lesss, the metastate approach suggests an alternative, nonstandard, RSB scenario, which 
we now describe. 

The idea behind the nonstandard RSB picture (referred to by us as the nonstandard 
SK picture in earlier papers) is to produce the finite-volume behavior of the SK model 
to the maximum extent possible. We therefore assume in this picture that in each A^, 
the finite-volume Gibbs state pj^ is well approximated deep in the interior by a mixed 
thermodynamic state F^ L \ decomposable into many pure states p aL (explicit dependence 
on J is suppressed for ease of notation). More precisely, each r in kj satisfies 

r=E^r r p« r (12) 

and is presumed to have a nontrivial overlap distribution for cr, a f from r(a)T(a r ): 

Pr(q) = E W^W^5(q - g Qr/3r ) (13) 

cer,Pr 

as did pj in the standard RSB picture. 

Because k j, like its counterpart pj in the standard SK picture, is translation-covariant, 
the resulting ensemble of overlap distributions Pr is independent of J . Because of the 
CSD present in this scenario, the overlap distribution for pj^ varies with L, no mat- 
ter how large L becomes. So, instead of averaging the overlap distribution over J ', the 
averaging must now be done over the states T within the metastate kj, all at fixed J: 



P 



IIS 



(?) = J Pr{q)nj{Y)aT . (14) 



The P ns (q) is the same for a.e. J, and has a form analogous to the P s {q) in the standard 
RSB picture. 

However, the nonstandard RSB scenario seems rather unlikely to occur in any natural 
setting, because of the following result: 

Theorem [40] . Consider two metastates constructed along (the same) deterministic 
sequence of A^'s, using two different sequences of flip-related, coupling-independent b.c.'s 
(such as periodic and antiperiodic). Then with probability one, these two metastates are 
the same. 

The proof is given in [40], but the essential idea can be easily described here. As 
discussed in Sec. 2, kj = Kj\ but Kj is constructed by a limit of finite dimensional 
distributions, which means averaging over other couplings including ones near the system 
boundary, and hence gives the same metastate for two flip-related boundary conditions. 

This invariance with respect to different sequences of periodic and antiperiodic b.c.'s 
means essentially that the frequency of appearance of various thermodynamic states r^ L ^ 
in finite volumes A L is independent of the choice of boundary conditions. Moreover, this 
same invariance property holds among any two sequences of fixed boundary conditions 
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(and the fixed boundary condition of choice may even be allowed to vary arbitrarily along 
any single sequence of volumes)! It follows that, with respect to changes of boundary 
conditions, the metastate is extraordinarily robust. 

This should rule out all but the simplest overlap structures, and in particular the non- 
standard RSB and related pictures (for a full discussion, see [40]). It is therefore natural 
to ask whether the property of metastate invariance allows any many-state picture. 

There is one such picture, which we have called chaotic pairs, and which is fully 
consistent with metastate invariance (our belief is that it is the only many-state picture 
that fits naturally and easily into results obtained about the metastate.) 

Here the periodic b.c. metastate is supported on infinitely many pairs of pure states, 
but instead of Eq. (12) one has 

T = (l/2) Par + (l/2)p_ Qr , (15) 

with overlap 

P r = (l/2)5(q-q EA ) + (l/2)5(q + q EA ). (16) 

So there is CSD in the states but not in the overlaps, which have the same form as 
a two-state picture in every volume. The difference is that, while in the latter case, one 
has the same pair of states in every volume, in chaotic pairs the pure state pair varies 
chaotically as volume changes. If chaotic pairs is to be consistent with metastate invari- 
ance in a natural way, then the number of pure state pairs should be uncountable. This 
allows for a 'uniform' distribution (within the metastate) over all of the pure states, and 
invariance of the metastate with respect to boundary conditions could follow naturally. 

4 Open Questions 

We have discussed how the metastate approach to the EA spin glass has narrowed consid- 
erably the set of possible scenarios for low-temperature ordering in any finite dimension, 
should broken spin-flip symmetry occur. The remaining possibilities are either a two- 
state scenario, like droplet/scaling, or the chaotic pairs picture if there exist many pure 
st cites clt some (j3,d). Both have simple overlap structures. The metastate approach 
appears to rule out more complicated scenarios like RSB, in which the approximate pure 
state decomposition in a typical large, finite volume is a nontrivial mixture of many pure 
state pairs. 

Of course, this doesn't answer the question of which, if either, of the remaining 
pictures actually does occur in real spin glasses. In this section we list a number of open 
questions relevant to the above discussion. 

Open Question 1. Determine whether a phase transition occurs in any finite di- 
mension greater than one. If it does, find the lower critical dimension. 

Existence of a phase transition does not necessarily imply two or more pure states 
below T c . It could happen, for example, that in some dimension there exists a single pure 
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state at all nonzero temperatures, with two-point spin correlations decaying exponentially 
above T c and more slowly (e.g., as a power law) below T c . This leads to: 

Open Question 2. If there does exist a phase transition above some lower critical 
dimension, determine whether the low-temperature spin glass phase exhibits broken spin- 
flip symmetry. 

If broken symmetry does occur in some dimension, then of course an obvious open 
question is to determine the number of pure state pairs, and hence the nature of or- 
dering at low temperature. A (possibly) easier question (but still very difficult), and 
one which does not rely on knowing whether a phase transition occurs, is to determine 
the zero-temperature — i.e., ground state — properties of spin glasses as a function of 
dimensionality. A ground state is an infinite-volume spin configuration whose energy 
(governed by Eq. (1)) cannot be lowered by flipping any finite subset of spins. That is, 
all ground state spin configurations must satisfy the constraint 

JxyVxVy > (17) 

(x,y)eC 

along any closed loop C in the dual lattice. 

Open Question 3. How many ground state pairs is the T = periodic boundary 
condition metastate supported on, as a function of dl 

The answer is known to be one for ID, and a partial result [41, 42] points towards 
the answer being one for 2D as well. There are no rigorous, or even heuristic (except 
based on underlying ansdtze) arguments in higher dimension. 

An interesting — but unrealistic — spin glass model in which the ground state struc- 
ture can be exactly solved (although not yet completely rigorously) was proposed by 
the authors [43, 44] (see also [45]). This "highly disordered" spin glass is one in which 
the coupling magnitudes scale nonlinearly with the volume (and so are no longer dis- 
tributed independently of the volume, although they remain independent and identically 
distributed for each volume). The model displays a transition in ground state multiplic- 
ity: below eight dimensions, it has only a single pair of ground states, while above eight 
it has uncountably many such pairs. The mechanism behind the transition arises from a 
mapping to invasion percolation and minimal spanning trees [46, 47, 48]: the number of 
ground state pairs can be shown to equal 2^, where M = M{d) is the number of distinct 
global components in the "minimal spanning forest." The zero-temperature free bound- 
ary condition metastate above eight dimensions is supported on a uniform distribution 
(in a natural sense) on uncountably many ground state pairs. 

Interestingly, the high- dimensional ground state multiplicity in this model can be 
shown to be unaffected by the presence of frustration, although frustration still plays 
an interesting role: it leads to the appearance of chaotic size dependence when free 
conditions are used. 

Returning to the more difficult problem of ground state multiplicity in the EA model, 
we note as a final remark that there could, in principle, exist ground state pairs that 
are not in the support of metastates generated through the use of coupling-independent 
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boundary conditions. If such states exist, they may be of some interest mathematically, 
but are not expected to play any significant physical role. A discussion of these putative 
"invisible states" is given in [7]. 

Open Question 4. If there exists broken spin-flip symmetry at a range of positive 
temperatures in some dimensions, then what is the number of pure state pairs as a 
function of (P,d)l 

Again, the answer to this is not known above one dimension; indeed, the prerequisite 
existence of spontaneously broken spin flip symmetry has not been proved in any dimen- 
sion. A speculative paper by the authors [49], using a variant of the highly disordered 
model, suggests that there is at most one pair of pure states in the EA model below eight 
dimensions; but no rigorous arguments are known at this time. 
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